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Adjoint Sensitivity Analysis of High Fidelity Simulations 


° Types of Sensitivity Analysis 


¢ Tangent: sensitivity of many objectives 
to one input parameter 


e Adjoint: sensitivity of one objective to 
many input parameters 
° Gradient-based Design Optimization 
e Error Estimation 


¢ Mesh Adaptation 
¢ Uncertainty Quantification 
e Systems with unsteady flows have 


many important objective functions 
that are time averaged 


——* Traditional sensitivity analysis fails for these objectives in 


high fidelity simulations, which exhibit chaotic dynamics 
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Lorenz 63 System 
Objective z: rate of heat transfer 


Input p: temperature difference 


Time 


Failure of conventional sensitivity analysis for chaos 
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Time Dependent Output 
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Sensitivity analysis approaches for chaotic systems 


vot oo a | 1. Ensemble Adjoint Method 
Pore e Lea etal. 2000, Eyink et al. 2004. 
2. Fokker-Planck Methods 


e Thuburn et al. 2005., Blonigan and 
Wang 2014 


3. Fluctuation-Dissipation Theorem 
. ¢ Leith 1975, Abramov and Majda 2007 
1. Ensemble adjoint sensitivities for short, medium, and 


isneqimneseements! 4. Least Squares Shadowing (LSS) 


L e Wang, Hui, and Blonigan 2014 


2. Fokker-Planck computed stationary density (left) and 4. LSS reference and shadow 
its adjoint (right). trajectories. 
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Sensitivity analysis with shadowing 


Conventional Objective Surface 
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Sensitivity analysis with shadowing 


In Phase Space: Shadowing Objective Surface 
_—— Trajectory °° 
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parameter. 


Least squares shadowing 


¢ Assume ergodicity, replace initial Shadowing Objective Surface 
condition for u(t) with 20 
ae 97 51.0 
min — W (t)||u(r(t)) — up (£) ||? dt 45.9 
OE alt 36 
ae 40.8 
s.t. = f(u;s + 6s) 35 357 
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variation of objective history with input 
parameter. 


Time averaged objective 


Least squares shadowing for Lorenz 63 


T1-To = 5.0 T1-To = 5000.0 
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Time averaged objective 
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e Lorenz 63 System 


g ° Objective (2-28): deviation of rate of 
heat transfer 


° Input p: temperature difference 


“Non-Intrusive” least squares shadowing 


° Originally proposed by Ni et al. (AIAA 2016-4399) 


° Reduces size of LSS minimization problem considerably by 


e Minimizing v(t) at K discrete checkpoints in time 


K 
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- t:)\? st. —=—v+——-+nf, —)= 
ming Sole? st. = Bet By ths (OG) =o 


° Expressing v(t) in terms of homogeneous and inhomogeneous components 


v(t) = » a;0;(t) + 6(t) 


J 
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——-> Choose a that solves the least squares problem 


Tangent NILSS Algorithm 


e Set Vo = — Qand Vo = Qo, a random orthonormal matrix. 
° For each segment starting with 1: 
1.Compute primal w(t) from t;-1 to t; 
2.Compute all m U;(¢) from ip? eae 
3.Compute QR-decomposition QO; R; = Vi ; cohen V,-} = v;(t;) 
4 Set es = OQ! 
5.Compute i(t) for O(t;_1) = V; with V; = (ZI — Qy-1 QO}, )0(t_,) 


° Solve 


R, 2 ™ — QP (ty) 
min s.t = 
Ak Ak TA _ 
R —T —O7-0(t 


° Compute sensitivity to s with ai’s and segment sensitivity contributions 9; and /; 
K 


dJ 1 7 OJ 
ae ~ ig nty 2 ai thi) + 5. 


Adjoint NILSS Algorithm 


¢ Set Vo = Q9, a random orthonormal matrix. 


° For each segment starting with 1: 


1.Compute primal u(t) from t;-1 to t; 


2.Compute all mV; (t) from 0; (t;-1) = , 
3.Compute QR-decomposition O;; = V, , — V,-]? = 8; (ts) 


4 Set : = QO! 
° Solve the minimization problem ia 
: i 
De - 


min 7 . 
= 3 : 


° Set w(t) = 9. For each segment starting with K solve the adjoint equation 
backwards from t to ti, where the matrix ;, and vector x; are related to t(t). 
dw Of 1 OJ T 
————— —_ i) HR, (2 -— 9:9; 7) — Oi) +2; 
FD we OF alte) = Ps, (E- QO w(t?) - Qe) +2 
° Compute sensitivities with 


dJ oF 
a7, Os |, Ny) or 


NILSS computational cost 


1 cost unit = primal solution for a single 
segment 


° Cost of Adjoint NILSS: ~(m+3)K units 
e Primal on K segments costs K units 


¢ m tangent solutions cost ~mK units 


° K QR-decompositions: 
¢ Parallel TSQR: 2Nporm2/P + 2m?/3 flops Channel flow: Vorticity magnitude isosurfaces 

» WWinimization Problem colored by streamwise velocity 
e Usually a relatively small cost 

e Adjoint on K segments costs ~2K units 
¢ File |/O could drive compute time 


° mis at least the number of positive 
Lyapunov exponents. 


e Re,=180 channel flow, m = 1,500 


* T106C turbine blade, m = 400 Turbine blade: Vorticity magnitude isocontours 
colored by mach number 
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Minimum Turbulent Flow Unit 


Smallest channel that can sustain turbulent flow 
(Jimenez and Moin, 1991). 


e Very good agreement with turbulent channel 
Statistics below y*=40 


Current study replicates a case in the original 
paper 

e Re=3000, Re,=140 

¢ Channel size=thx2hx0.34rh 


Flow Solver: ety 


¢ Discontinuous Galerkin Spectral Element Method 
(DGSEM) framework 


¢ Space-time DG discretization 


Q-Criterion 
isosurfaces colored 
by x-momentum 


e Entropy stable flux of Ismail and Roe 
Mesh: 32x128x16 Degrees of Freedom 


Roughly 150 positive Lyapunov exponents —————» 
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NI-LSS Sensitivity 
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Eddy Turnover Time 


e NI-LSS run with 160 modes 
° Objective function is volume-integrated kinetic energy 


° Sensitivity to Re: computed 


141 142 143 = 144 


e Slow convergence of sensitivity due to long time scales present in flow unit 


15 


NI-LSS Adjoint 


¢ Shadowing adjoint does not exhibit 10! 
exponential growth 


¢ Adjoint provides physical insights om 
e Largest adjoint magnitudes occur before 10! 
“blooming” of turbulence indicated by wall } 
shear stress T. 0” 
: ) 30 


Turbulence “Blooming” 10°9 


Adjoint Norm 
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Q-Criterion isosurfaces colored by x-momentum 0.7 
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Eddy Turnover Time 


Flow Unit Adjoint Field 


Q-Criterion isosurfaces Adjoint X-momentum 
colored by x-momentum isocontours for +2.0 


Walls colored by shear 
force Magnitude 


e Integrated kinetic energy adjoint shows when and where flow is most susceptible 
to flow instabilities 


Adjoint Field and Z-vorticity 


Snapshots from t=12.13 


Contour lines: adjoint X-momentum 
Color map: X-mometum 


Flow 


> Color map: Z-vorticity 


Contour lines: adjoint X-momentum 


Colored isocontours: adjoint X-momentum for +2 
White isosurfaces: Z-vorticity magnitude=1.9 —_ 


ee ee 


° Time-averaged, volume-integrated kinetic energy is sensitive to perturbations in 
the sheets of Z-vorticity being transported away from the walls. 
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Optimal Perturbation for Transition 


e Streamwise velocity magnitude ¢ Adjoint X-momentum field for flow unit 
contours for a flow perturbation prior to turbulence “blooming”: 
optimized to increase the kinetic 
energy of Re=610 flow over a flat plate 
(Cherubini et al. 2010, JFM): 
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: 
0 "100 00 3¢ 400 
X—Xin 
Solid lines: domain length = 400 units Contour lines: X-momentum adjoint 
Dotted lines: domain length = 800 units Color map: Z-vorticity 


———> X-momentum perturbations suggested by the adjoint are similar 


to the optimal velocity perturbations computed by Cherubini et al. 


Conclusions and Future Work 


Conventional sensitivity analysis fails for chaotic dynamical systems such as scale- 
resolving turbulent flow simulations 


Shadowing-based sensitivity analysis is a promising approach for chaotic systems 
Non-Intrusive LSS can compute useful sensitivities 
- Cost scales with the number of positive Lyapunov exponents 


Shadowing adjoint provides valuable physical insights into turbulent flows 


Next Steps: 
- Shadowing for other canonical turbulent flows including axis-symmetric jets 
- Explore approaches to reduce cost of NILSS 


- Study other shadowing algorithms such as multiple shooting shadowing 
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Lyapunov Analysis 


e Phase Space for system —— 7 


Trajectory for 0u/Ot = 


f(u;s) 


Uniform 
Perturbations 


Lyapunov exponents: Avg. rate of deformation 
Covariant vectors: direction of deformation 


——> Exponent signs indicate long-time dynamics: 
Steady Periodic Chaotic 


All Negative Zero, Negative Positive, Zero, Negative 
——*> Positive Lyapunov exponents responsible for the butterfly effect 
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The Shadowing Lemma 


Reference Trajector 
Shadow Trajectory —+, y 
t i “Ry . 


Consider a system governed by 


du 


dt = f(u;s) 


For any 6>0 there exists €>0, such that for every “e-pseudo-solution” u satisfying ||du/dt-f(u)||<e, 
there exists a true solution u satisfying du/dt—-f(u)=0 under a time transformation t(t), such that 
|lu(t)-u(t)|/<6, [1-dt/dt]<6é 
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Time Transformation 


Shadow Shadow 
Sw Trajectory ‘Lrajectory 
Reference Reference , 
LY a] ectory \ dT ‘Lraj ectory 
ur(t) a(ri1) Urb) w(Te+1) 


. 
Ur ( Ci+1 
Ur ( tj 


Without Transformation 
d d 
S| m4] 
dt dt 


Time transformation is required to keep the trajectories close in phase space for 
all time 


Le) 
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Additional NILSS Definitions 


° Tangent: 
dv; Z OF « si dp cape dt Z Cla Of ri _, 
dt auth PW =V On on 
_ K = 
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e,°e e . j j hi) 
——> Sensitivity: cP -— eA 2 gi 4 + TO 
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dw [of]” 1 OJ _ Pe. ek 
ss = ff — i Cr ae LI — 9,9; t; )-— Divi) + 2; 
dt ES tx —ty Ou w(t) = Pas (E— Q:@5 Jules) — Qs) +2 
Sensitivity: Bef) wey are 
——> Sensitivity; | = . dsl, Fe 
° Definitions: 
1 ti OJ 1 % Od| . a 
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Development of a compressible entropy-stable high-order space-time 
discontinuous Galerkin spectral element method (DGSEM) framework 


Haswell 


DGSEM to efficiently reach spectral limit both in 16 
space and time (N 2 8) 


Sandybridge 


Nehalem 


(flops /cycle) 


° Less discretization errors and efficiency 


e Better match for current/future hardware 


Performance 


° Low dependance on mesh quality ie 


° h-p adaptation 


Entropy-stable formulation 
e Entropy variables 


° Space-time DG discretization 


Dissipation Rate 


e Entropy stable flux of Ismail and Roe 


e “Exact” quadrature using local de-aliasing 


Time 


Flow Unit Adjoint Field 


~ 


- 


Contour lines: X-momentum adjoint 
Color map: X-mometum 


¢ Adjoint for integrated kinetic energy shows when and where flow is most 
susceptible to flow instabilities 
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